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13. ABSTRACT (Maximum 200 words) 

Lateral migration radiography (LMR) is a new imaging technique based on ideas of Compton backscatter imaging. In LMR, multiple image 
sets are generated. Uncollimated detectors provide images that are due primarily to single-collision photons which have been mainly 
scattered from the soil surface or near-surface. Collimated detectors provide images that are due primanly to multiple-collision photons that 
contain both surface and sub-surface information. 

Simple noise removal and image enhancement techniques, including weighted filters, Weiner filters and histogram equalization improved the 
visibility of objects and of object details. Linear combinations of collimated and uncollimated images provided a fast, simple means of 
surfact-object removal and of yielding additional details for mine detection. Optimal filters that maximize the signal-to-noise ratio and include a 
prewhitening step were particularly useful for identifying deep-buried mines. Finally, simple neural networks gave good image enhancement 
results and are espically efficient for surface-laid object removal. 


for surface-laid object removal. 




Landmine detection, Compton backscatter imaging, lateral migration radiography, image processing, neural 


networks 





OF REPORT 


OF THIS PAGE 


OF ABSTRACT 





UNCLASSIFIED 


UNCLASSIFIED 


UNCLASSIFIED 












Image Processing Techniques for 
Lateral Migration Radiography 
Land Mine Images 


Technical Report 
ARO Grant Number 
DAAG-55-98-1 -0400 


By 

Anthony Allard 
Edward Dugan 
Alan Jacobs 


NUCLEAR AND RADIOLOGICAL ENGINEERING DEPARTMENT 
UNIVERSITY OF FLORIDA 
Gainesville, FL 32611 
June, 2000 



Acknowledgements 


The author would like to thank Dr Dugan and Dr Jacobs for all their support and advice 
in this work. And the author would also like to thank Zhong Su and Chris J. Wells, two 
graduate students, for all their help. 

The material in this report is based upon work supported by, or in part by, the U.S. 
Army Research Office under grant number DAAG-55-98-1-0400. 






TABLE OF CONTENTS 


Pages 

ACKNOWLEDGEMENTS 1 

INTRODUCTION 1 

SECTIONS 

1 INTRODUCTION TO X-RAY LATERAL MIGRATION RADIOGRAPHY 3 

1- Principles. 3 

2- Interpretation of the images. 5 

3- Mathematical model of the system. 6 

2 IMAGE ENHANCEMENT 8 

1- Noise removal. 8 

1-1 - weighted average filters. 9 

1- 2- Wiener filter. 10 

1-2-1- introduction to Wiener filter. 10 

1 -2-2- mathematical model. 10 

1-2-3-results. 11 

2- Color manipulation. 13 

2- 1 - histogram equalization. 1 3 

2- 2- other techniques. 14 

3- Conclusion. 15 

3 LINEAR COMBINATION TECHNIQUES 16 

1- Image characteristics. 16 

2- Image subtraction. 17 

3- Removal of surface laid objects. 18 

3- 1- model of the problem. 18 

3-2- simple subtraction. 19 

3-3- interpolation and subtraction. 21 

4- Conclusion. 22 






















4 IMAGE FILTERING 


23 


1- Introduction. 23 

2- Signal source separation. 23 

2-1- Herault-Jutten signal separation method. 24 

2- 2- results. 25 

3- Optimal filtering. 28 

3- 1- optimal filtering theory. 29 

3-2- application to LMR images. 31 

3-3- prewhitening step. 32 

4- Conclusion. 35 

5 NEURAL NETWORK 36 

1- Introduction. 36 

2- From biological neurons to artificial neurons. 37 

2-1- biological neurons. 37 

2- 2- artificial neurons. 38 

3- Artificial neural networks. 39 

3- 1 - architecture of artificial neural networks. 39 

3- 2- tr aining an artificial neural network. 42 

3-2-1- supervised learning. 42 

3- 2-2- backpropagation training for a multiplayer neural network. 44 

4- Application of neural networks to LMR images. 46 

4- 1- build the input and the output. 47 

4- 1-1- nature of the input and the output. 47 

4-1-2- rescale the input and the output vectors... 48 

4-2- set the parameters of the network. 49 

4-2-1- number of layers and neurons. 49 

4-2-2- the activation function. 50 

4- 3- choice of the learning examples. 51 

5- Experimental results. 52 

5- 1- size of the selection square. 53 

5-2- influence of the number of neurons. 53 

5-3- influence of the K coefficient. 55 

5-4- final results. 55 

6- Conclusion. 61 

6 AUTOMATIC IMAGE PROCESSING 63 

1- Introduction. 63 

2- Object recognition. 63 

2-1- contour detection. 63 

2-2- labeling task. 65 

3- Conclusion. 66 









































7 USER INTERFACE 67 

1- Description of user interface . 67 

2- Command description. 68 

2-1- image commands. 68 

2-2- filter. 68 

2-3- linear combination. 69 

3- Architecture of the program. 70 

CONCLUSION. 72 


REFERENCES 


73 











Introduction 


Lateral Migration Radiography (LMR) is a new imaging technique, developed at the 
University of Florida (UF) which based on ideas of Compton backscatter imaging 
systems [1]. The UF mine detection project developed an LMR system in a laboratory 
setting for the detection of land mines. This system consists of an x-ray generator and two 
pairs of detectors along with a data acquisition system. Monte Carlo simulations of the 
LMR system have shown that the uncollimated detectors mainly detect the once-scattered 
photons that have been reflected near the surface, while the collimated detectors mainly 
detect the multi-scattered photons that have undergone sub-subsurface collision. Thus, 
the unco llimat ed images primarily contain inf ormation about the surface or near surface 
features, while collimated images primarily contain information on the subsurface 
features. 

When applied to a real or surrogate mine [2], this system has proven to be an efficient 
technique to get information not only on the position of the mine, but also on the main 
features of the mine. However, in some unfavorable situations, like a deep depth-of- 
burial (DOB) or in the presence of surface laid objects, the quality of the image of the 
buried mine can be greatly degraded. This report details the theoretical basis and the 
application to LMR images of several image processing techniques which use the 
characteristics of the LMR images to improve the quality of the image, to emphasize the 
photon energy deposition in the mine, or to remove the surface laid objects. 
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In Section 1 we look at the LMR principle and the characteristics of the measured 
images. In section 2 we study some general image enhancement techniques that can be 
applied to LMR images. In Sections 3, 4 and 5 we describe some linear combination 
techniques, an optimal filter and a neural network, respectively, used to emphasize the 
image of the mine or to remove the surface laid objects. In Section 6 we discuss the 
automatic treatment of the LMR images. And next, in Section 7, we present the user 
interface program 
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Section 1 


Introduction to X-ray 
Lateral Migration Radiography 


1- Principles 

Lateral Migration Radiography is a technique that uses the lateral transport of multi- 
scattered photons in material to form images. 



Figure 1: Schematic of a X-Ray Lateral Migration Radiography system. 


This X-Ray Lateral Migration Radiography method is based on two different kinds of 
photon interactions: Compton scattering and the photoelectric effect. These two 
interactions are functions of electron density, effective atomic number of the migration 
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material, and photon energy. Thus, the energy of the backscattered photons which reach 
the detector depends on the nature of the materials the photons have been reflected from. 
The final image is made of m x n pixels, each pixel representing the energy deposition on 
the detectors when the beam is positioned at that pixel location. 

The LMR system used for the landmine detection project utilizes one X-Ray source and 
two detector types to form images: collimated and uncollimated. The collimated detectors 
are used to detect photons that undergo lateral migration. The collimators prevent 
photons that have undergone only one collision from reaching the detector; thus, the 
collimated detector signals primarily contain information on the subsurface features. The 
uncollimated detectors effectively detect the photons that hit the surface and scatter 
directly back; thus the uncollimated detectors signals primarily contain information on 
the surface, or near surface, features. 

Figure 2 is an example of an image of a surrogate mine with a flush depth of burial 
(DOB). 
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Figure 2: Front uncollimated detector image of a surrogate mine, flush DOB 
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2- Interpretation of the images 

The energy deposition in the collimated detectors is mainly due to the energy deposition 
from multi-scattered photons. 

The Compton scattering cross section is greater for a plastic mine than it is for the soil, so 
the photons migrating through the mine have a higher probability of being scattered out 
of the soil and being registered by one of the detectors. Therefore, when the x-ray beam is 
scanning toward the mine and just reaches the front edge of the mine, the forward 
direction migrating photons are transported more readily than in any other direction and 
are registered in the front collimated detector. Because of this, the highest intensity seen 
in the front collimated detector is seen earlier than the actual physical center of the mine 
and this appears as a backward shifting of the mine in the front collimated image. In the 
rear, the opposite appears. This shifting varies directly with the depth of burial of the land 
mine. Figure 3 shows the shift for a surrogate plastic mine with a flush depth of burial. 
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Figure 3: Front and rear collimated detector images of a surrogate mine with a flush DOB. 


5 





3- Mathematical model of the system 

The subject of all the work has been to improve the LMR images, applying signal and 
image processing techniques. So we need to define a mathematical model of the system. 
The images observed are a measurement of the energy deposition in the collimated and 
uncollimated detectors due to the reflection of the photons from the soil, the surface laid 
objects and the buried objects. Thus the total energy deposition on each detector can be 
modeled as: 

ic(x,y) = b c (x,y) + s c (x,y ) + l c (x,y) 

|wO, y) = b u (x, y) + s u (x, y) + l u (x, y) 

where : c(x, y): is the energy deposition at pixel (x, y) in the collimated detector. 

w(x, y ): is the energy deposition at pixel (x, y) in the uncollimated detector. 
b c (x,y): energy deposition in the collimated detectors due to the reflection of 
photons from buried objects. 

b u {x,y ): energy deposition in the uncollimated detectors due to the reflection of 
photons from buried objects. 

s c (x,y ): energy deposition in the collimated detectors due to the reflection of 
photons from the soil. 

5 u (x,y): energy deposition in the uncollimated detectors due to the reflection of 
photons from the soil. 

l c (x,y): energy deposition in the collimated detectors due to the reflection of 
photons from surface laid objects. 
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l u (x,y ): energy deposition in the uncollirnated detectors due to the reflection of 
photons from surface laid objects. 

All these notations are used in this report. 

So now that we have described the principles of the landmine LMR system, the 
characteristics of the images and a simple mathematical model of the images we can start 
studying some image processing techniques. 
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Section 2 


Image Enhancement 


The process of image acquisition frequently leads to image degradation. Due to 
instrumentation noise, non-uniform soil, surface clutter, etc., the LMR images can be de- 
gaded. The goal of image enhancement is to improve an image, where ‘improve’ is 
sometimes defined objectively (e.g., increase the signal-to-noise ratio), and sometimes 
subjective^ (e.g., make certain features easier to see by modifying the colors or 
intensities). 

1- Noise removal 

As introduced in Section 1 and taking into account n(x,y ), the instrumentation noise, we 
can give a new model for the acquired images: 

o(x, y) = b(x,y) +1 (x, y) + s(x, y) + n(x, y) 

where: 

o(x ,y): total energy deposition in the detector 
b(x,y ): energy deposition from the buried objects 
l(x, y ): energy deposition from the surface laid objects 
s(x, .y): energy deposition from the soil 
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In the case of a non-uniform soil, s(x,y) can also be considered as a noise. 

Sometimes the energy deposition due to the soil, considered as a noise, when added to the 
noise from the detector gives a signal that is higher than the energy deposition from the 
buried objects; so we can not see the buried object in the image. To improve these images 
a first idea would be to apply different noise removal techniques. 


1-1- Weighted average filters 

Weighted average fibers are very simple, spatially, low pass filters that can be used to 
remove statistical noises and some small soil irregularities. These filters use a weighted 
mask filter to compute the new value of the pixel located at the center of this mask. 


1/9 
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Figure 1: Mask of the mean filter 

But low pass filtering often leads to edge deterioration. So we introduce an adaptive low 
pass filter. 
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1 -2- Wiener filter 


1-2-1- introduction to Wiener filter 

An adaptive low pass filter is a filter which adjusts its pass-band to each situation. When 
encountering a uniform region this filter applies a low pass filter with a small band-pass 
to smooth this region, but when encountering an object’s contour this filter increases its 
band-pass to avoid deteriorating the edge. 

1-2-2- mathematical model 

We note d(x,y) = b(x,y) + l(x,y) the signal we want to observe, and 
nn(x,y) = n(x,y) + s(x,y) the noise added to the image. We assume that these two 
signals are centered (if not, we center them). 

The noisy observation o(x,y) is given by: 

o(x,y) = d(x,y) + m(x,y) 

We wish to determine d(x,y) from o(x,y) using a linear estimator given by 

d(x,y) = o(x,y)*h(x,y ) 

where * is the convolution product and h(x,y ) a linear filter. 

The linear estimator we used is based on the Linear Minimum Square Error; the criterion 
used is the minimiz ation of an error: 

Error = E{\e(x,y)\ 2 } 
e{x,y) = d(x,y)-d(x,y) 


10 




This signal estimation problem can be solved using the orthogonality principle. This 
principle states that the Error function is minimized by requiring that e(x,y) be 
uncorrelated with o(x,y ). This leads us to the following result: 




PJP ,<*) 
P 0 M) ’ 


where is the interaction power spectrum of d and o, and P Q the power spectrum of o. 
This filter H(u,<f >)is called the noncausal Wiener Filter. 


If we suppose that nn is a white noise, then we can show that 

P do (P,<f>) = PM<t>) 

PoiP’P) = P d (P’<t>) + P nn(P,<!>) 


So the noncausal Wiener filter is given by: 




P d {v4) 

P^D^ + P^UJ) 


1-2-3- results 

If we apply this filter to the whole image, then the resulting image is not well filtered. 
Indeed, when calculating the Wiener filter we made the assumption that the noise 
nn(x,y)\s a white noise. However, if we assume that the noise nn(x, y) is larger than 
d(x,y ), then the autocorrelation function of o(x,y) can be considered as the 
autocorrelation of the noise nn{x,y), which should be a Dirac function for a white noise. 
However, this is not what we observe on Figure 2. 
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Raster Direction (pixels) 0 0 Vehicle Motion (pixels) 


Figure 2: Autocorrelation function of o(x,y) 

So to overcome this problem we apply this filter locally so that now we use an adaptive 
Wiener filter which locally estimates P 0 (x,y) and P d (x,y), where m(x, y) can be 
considered as a white noise. Then the new filtered signal is: 

d(x,y) = m d (x,y) + — r — -(o(x,y)-m d (x,y)) 

_ Qd (x t y) + cr m (x,y) _ 

where m d (x, y) is the estimated mean value of d in the local neighborhood. 

So this new filter is an adaptive filter which tailors itself to the local image variance. 
Where the variance of the image is large this filter performs little smoothing; where the 
variance is small, this filter performs large smoothing. 

The results are shown on Figure 3b. 
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vehicle motion 



Figure 3a: Original image Figure 3b: Wiener filtered image 


So this Wiener adaptive filtering method is a good way to reduce noise without altering 
the contour as would be done with a simple low-pass filter. However, this filter is not 
able to point out a buried mine when it is totally hidden under the energy deposition due 
to the soil. 


2- Color manipulation 

2-1- Histogram equalization 

When plotting a 2D landmine image, Matlab software, like most of the software, uses 
colors to show the distribution of energy. In the case of low contrast images, for example 
when the mine is deep-buried, there is one predominant color and so we cannot see any 
details. A technique to increase the contrast of an image is to equalize the histogram of 
the image so that the number of pixels per energy container is about the same for each 
one. 

Figures 4a and 4b represent the histogram and the image of a plastic mine centered with a 
DOB of 3 inches. Figure 5a and 5b represent the new histogram and the image after 
performing a histogram equalization. 
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Figure 4a: Histogram of the original image 
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Figure 4b: Original image interpolated to 
200*200 pixels 
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Figure 5a: Histogram after equalization Figure 5b: Image after histogram 

equalization 

interpolated to 200*200 pixels 


2-2- Other techniques 

To increase the contrast of some images we can use other techniques such as the gamma 
correction which maps the value of the pixels to some other values using a specified 
function like a linear function. 

These methods can be useful but are highly correlated to the nature of the image. 
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3- Conclusion 


In this section we have presented some image enhancement techniques that improve the 
quality of the images. These techniques are very general and do not take into account the 
specificities of the LMR system. So in the next sections we introduce new signal and 
image processing techniques specific to the LMR system which will help the user to 
decide whether or not there is a buried mine in the soil. 
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Section 3 


Linear Combination Techniques 


In this section we study some linear combination techniques based on the characteristics 
of the LMR system that will help the user to conclude whether or not there is a mine 
present. 


1- Image characteristics 

As explained in Section 1, uncollimated images primarily contain information on the 
surface features and collimated images contain information on both surface and 
subsurface features. In addition, we can observe a shift in the apparent location of a 
buried mine in both front and rear collimated detectors. 

So in this section we will use these characteristics to remove surface laid objects that may 
‘hide’ buried objects, or point out these objects. 
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vehicle motion 


2- Image subtraction 

Because of the shift in the position of the buried objects, and because surface laid objects 
remain at the same position, we could subtract collimated images to remove surface laid 
objects and point out buried objects. 

To do so we have to normalize both collimated images. One possible normalization is to 
divide each image by its total energy. 

The result of this technique is shown on Figure lc for a surrogate plastic mine centered 
with a DOB of 1 inch and a stick of wood and a rock laid on the surface. 



20 40 60 80 100 120 

raster direction 


Figure la: Original rear collimated image 



raster direction 

Figure lb: Original front collimated image 
xio" 3 



raster direction 

Figure lc: Image obtained by subtraction of both collimated images 
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So on the one hand, the mine is more visible in the resulting image and appears at two 
locations, one showing a signal intensity increase and the other an intensity decrease. On 
the other hand, the stick of wood has been removed, but the rock still appears. This is 
due to the fact that there is a shift in the position of the rock too. 

So this method is a very simple and efficient way to point out buried mines which then 
appear as two objects with the same shape but with opposite signal intensities, shifted in 
the vehicle motion direction. But sometimes it fails in removing surface laid objects. 


3- Removal of surface laid objects 

In some cases surface laid objects can ‘hide’ some buried mines in the collimated images. 
So we might need to remove them. To do so we use the fact that uncollimated detectors 
respond primarily to surface laid objects. 

3-1- Model of the problem 

A model of the energy deposition in both collimated and uncollimated detectors is 
(Section 1): 

\c(x,y) = b c (x,y) + s c (x,y ) + l c (x,y) (1) 

|tt(x,y) = b u (x,y) + s u (x,y) + l u (x,y) (2) 

If we assume that the soil is uniform without any slope, we can easily remove s c (x,y) 

and 5 u (x,y) . To do so we consider that the energy deposition most represented in each 


detector is the energy deposition from the soil which we can extract using the histogram 
of the image. 


IS 




3-2- Simple subtraction 

In a first approach we can assume that the energy deposition in the uncollimated detectors 

is only due to the reflection of the photons from surface laid objects, which means that: 

u(x,y) = l u (x,y) = aJ c (x,y ). 

- 1 
So b c (x,y ) = c(x,y) - l c (x,y ) = c(x,y) - —J u (x,y) 

_ - 

b c (x,y) = c(x,y) - .u(x,y) 

_ a _ 

where a is a normalization factor. 

Figure 2 summarizes the method: 


Collimated image Uncollimated image 



Figure 2: Block diagram of the surface object removal method 
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Figure 3a represents the original collimated image and Figure 3b the output image of this 
surface object removing technique. 
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Figure 3a: Original collimated image. 2 buried mines centered at 
(150,70) and (50,160) and 3 surface laid objects 
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raster direction 

Figure 3b: Image after removing surfece 
laid objects 
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The resulting image is not very good because when removing the stick of wood from the 
collimated image we also remove a part of the energy deposition from the mine. Indeed, 
the uncollimated detector also responds to the buried objects. So u(x,y) is not equal to 
l(x,y) but u(x, y) = l u (x,y) + b £ u (x,y) (3), where e means that the energy deposition due 

to the reflection of photons from buried objects exists but its contribution to the total 
energy deposition is low. So to improve the result of the technique, taking into account 
this new element, we can develop a new technique. 

3-3- Interpolation and subtraction 

We can estimate b £ (x,y) using the frontier pixels of the object on the uncollimated 
image and an interpolation technique based on Laplace’s equation. 

Then, using equation (3), l u (x,y) can be estimated by: 

K ( x , y) = u(x,y) -b £ (x, y) 

A 

And so, using equation (1), b c (x,y ) is: 

A A 1 * 

b c (x,y) = c(x,y) -l c (x,y) = c(x,y) — .l u (x,y) 

ct 

b c (x,y) = c(x,y) -—.[«(*,y)-^(*,>o] 
a 
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Figure 4 shows the output of this new method when using the same collimated and 
uncollimated images as for Figure 3. 



faster direction 

Figure 4: Image after removing surface laid objects (using interpolation and subtraction) 


So this method is more efficient in removing surface laid objects than the first one which 
didn’t use the interpolation step. However, this second method requires a selection of the 
surface laid objects to remove. So far this selection has been done manually. We will 
discuss automatic selection in Section 6. 


4- Conclusion 

In this section we have presented some linear combination techniques based on the 
properties of the collimated and uncollimated images. Using these techniques we were 
able to remove surface laid objects and to point out buried mines. These methods appear 
to give an indication to the user that allows him to decide whether or not there is a mine 
buried in the soil. In the next section we introduce some filtering techniques. 
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Section 4 


Image Filtering 


1- Introduction 

In this section we study two filtering techniques designed to point out the buried objects 

in the collimated images. 

In Section 1 the physical system is modeled by: 

| c(x, y ) = b c (x, y) + s c (x, y) + l c (x, y) 

!«(*, y) = K (x, y) + s u (x, y) + l u (x, y) 

The main purpose of this study is to apply some signal and image processing techniques 
that would help the user to make a decision regarding whether or not there a buried mine. 
So in an ideal situation we would like to extract b c (x, y) from the collimated images. 

2- Signal source separation 

Over the last decades. Signal Source Separation has been an important field of research in 
Signal Processing. This technique aims at extracting source signals from mixture signals. 
In our case we would like to extract b c (x,y ) from collimated and uncollimated images. 




Most of the Signal Source Separation techniques are based on the statistical independence 
of the source signals and aim at computing statistically independent outputs by linear 
combination of the inputs (the mixture signals). Figure 1 illustrates the principle: 



*2 

Figure 1: Signal Source Separation principle 


Sj, s 2 : statistically independent source signals. 
jCj x 2 : mixture signals. 

output ,, output j: statistically independent signals. 

2-1- Herault-Jutten signal separation method 

To test signal separation methods, when applied to the LMR imaging system, we used the 
Herault-Jutten method [3]. This method is based on a neural network which adapts its 
internal coefficients to achieve the statistical independence of the outputs. Figure 2 
explains the principle of this method: 
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{ output , =Xj -a v output 2 
output 2 = x 2 - o 2 .output x 

By an iterative algorithm a, and a 2 are adapted to achieve the statistical independence of 
the outputs. 


2-2- Results 

To test this method of signal separation, we first used a mixture of two spatially 
independent signals with a correlation coefficient of -0.29. This correlation coefficient is 
defined for two functions a and b by: 


1 2 Z (*& J) ~ /> " ■ h ) 


(q,6) _ 

P <x a o b var ianceia). var iance(b) 

where o and Zj are the mean values of a and b. 

\p\ e [0;l]. As \p\ increases, the spatial correlation between the two images increases. 


For these two test images the Herault-Jutten method is a success because the outputs 
correspond to the two original images, as shown in Figures 3. 
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Figure 3a: Source image 1 

Figure 3b: Source image 2 


Vehicle Motion (pixels) 

Figure 3e: Signal estimated 1 
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Figure 3c: Mixture 1 


Figure 3d: Mixture 2 
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Figure 3f: Signal estimated 2 

















Next, we apply this signal source separation method to different real LMR images. 

Each image was taken in standard conditions with a buried mine and a rock laid on the 
surface, and a flat and uniform soil. 

We didn’t succeed in obtaining two output images, each representing the mine and the 
rock, as shown in Figure 4. 
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Figure 4a: Measured image 1 


Figure 4b: Measured image 2 
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Figure 4c: Output image 1 


Figure 4d: Output image 2 


Figures 4a, b, c, d:: Input and Output images of the Herault-Jutten method. 

These images are 29x29 pixels images with 2 mines centered in pixels (12;7) and (17;15). 


However, the Herault-Jutten algorithm converged, which means that the final outputs 
were uncorrelated images. So we can assume that the source images, which are the 










images of the mine and the rock, are statistically dependent images ( because they can be 
considered as a linear combination of two statistically independent images (the outputs) ), 
which means that the fundamental assumption of the signal source separation techniques 
is not satisfied. So we cannot apply signal separation source techniques to estimate the 
image of each mine. 

The idea of using signal separation source techniques was maybe optimistic because we 
tried to retrieve the images of each single object (buried mines or surface laid objects), 
without giving the algorithm any information about the signal we were looking for. 


3- Optimal Filtering 

All we are interested in is the mine; everything else can be considered as noisy 
information and treated as noise. So far we have not used the information we have about 
the mine signal we are looking for. Thus, a new idea is to use a method that could 
distinguish the mine from the noise, using some information about the mine. 
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3-1- Optimal Filtering Theory 

First, we assume that we know exactly the signal of the mine we are looking for, b(x,y ), 
and we note that n{x,y ) is the noise in the image. Thus, the collimated image is 

c(x,y) = b(x,y ) + n(x,y) 

If (x 0 ,.y 0 ) is the center of the buried mine, then what we want to compute is the linear 
filter that maximizes the following signal-to-noise ratio that will point out the mine. 


* a (Wo) 


Power b (x 0 ,v 0 ) 

---at the location (x 0 , v 0 ). 

Power nt (x 0 ,y 0 ) 


^(x,y) = g*b(x,y) 
1 n l (x,y) = g*n(x,y) 


b(x,y) 


► b x (x,y) + n x {x,y) 

\ 

n(x,y) 



Figure 5: Filtering sytem 


3-1-1- Power bi (x Qi y 0 ) 

b { (x,y) is a deterministic signal, so Power b {x Q ,y 0 )=b^{x 0 ,y 0 ). Using the inverse 
Fourier transform we can write: 

1 M-\ N-l fa 7 V 

b i( x o>y 0 ) =—Xil B i (*»0 exp(2 +-^)), 

MN k=0 i=o M N 

where B x (k, /) is the Fourier transform of b t (x, y ). 
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B l (k,l) = G(k i l)B(k,l) 


1 M-\N~\ fa Jy 

*,(W.) « ^£E G <*.W*.0exp(2/<^+^-)) 

MN Zoto M N 

where B(k,l) is Fourier Transform of 6(x,y). 


3-1-2- Power„ t (x 0 ,y 0 ) 


We assume that n(x,y) is a statistical signal, stationary to the second order so: 

Power^ (x 0 ,y 0 ) = E{ n \(x 0 ,y 0 )} = (0) = TF~ l {Q nn (<U)}(0,0) 


1 

MN 

1 

MN 


M-lN-X nn if) 

m (kj). exp(2z it(~- + —)) 
k=o i=o M Is 

M-lN-l 

££|G(*,7)fQ„,(M) 

k=0 1=0 


where Q m (k,l) = N(k,l).N(k,l)and Q„ jBi (*,/) = N^kJ^ikJ). N(k,l) and N x (k,l) 
are the Fourier Transforms of «(x,y) and n x (x,y ). 


3-1-3- Optimal Filter 
Finally, 


Z 2 (x 0 ,y 0 ) = 


i M-lN-l fa 

ITT, J,'Zoa,I)B(k,I)txp(2iz(~i. + 

MN k= o /^o M 



2 


1 

MN 


M-lN-l 

££|g(*,/)| ru*,/> 


0) 


If we assume that n(x,y) is a white noise, then Q. m (k,l) — K, M(k,l). Then, using the 
Cauchy-Schwartz inequality, we can show that the linear filter g(x,y) that 
maximizes^ 2 (x 0 ,y 0 ) is: 
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3-3- Prewhitening step 

When computing the optimal filter we made the assumption that the noise signal n(x,y) 
is a white noise. In the previous situation the energy deposition from the soil can be 
considered as a white noise. Indeed, if we consider that the energy deposition from the 
mine is very low compared to the energy deposition from the soil, then the 
autocorrelation fimction of the noise is very similar to the autocorrelation function of the 
collimated image. Figure 7 displays this autocorrelation function which is very close to 
the autocorreleation function of a white noise, a Dirac fimction. 



Raster Direction (pixels) 0 0 Vehicle Motion (pixels) 

Figure 7: Autocorrelation function of the collimated image 


However, this condition is not always true, and so the filter we use may sometimes not be 
the optimal filter. So in this case we must compute the optimal filter without making this 
assumption. To avoid resolving the difficult equation (1), a solution to is to bypass this 
difficulty by using a prewhitening step. 
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The prewhitening step consists of a filter, h(x,y ), that ‘whitens’ the noise n{x,y ), before 
filtering the collimated signal c(x,y). 


b(x,y) 



-> b 2 (x,y) + n 2 (x,y) 


n(x,y) 

Figure 8: Prewhitening system 


Several filters have been developed to whiten a signal. The one we used in this study is 
the one of L.P. Yaroslavsky [4]. 

If we let a(k,l) be the Fourier Transform of the collimated image where all the pixels in 
part occupied by the buried objects have been put to zero, then the whitening filter 
frequency response is: 



Then what we maximize is: 


Z 2 (Wo) = 


Power bi (x 0 ,y 0 ) 
Power(x 0 ,y 0 ) ’ 


where the noise n 2 (x,y) is a white noise. 


Using the previous method we can easily compute the optimal filter that separates 
b 2 (x,y) from the noise. However, we are not interested in b 2 (x,y), which is a filtered 
image of b(x,y) by h(x,y ), but in b(x,y). So we can add a last step which is the inverse 
filtering h~\x,y ). Thus, the global filtering system is: 








Whitening 

filter 


Optimal 

filter 


Inverse-whitening 

filter 


Figure 9: Global optimal filtering system with prewhitening and inverse whitening step. 

In this case g(x, j)is the filter that optimizes but we are not sure that it is the 


filter that maximizes the signal-to-noise ratio after the last inverse-filtering step. 

This method gives better results than the previous one without the prewhitening step 
when the noise is not white. This is shown in figures 10b and 10c. 




Figure 10a: Collimated image. Plastic mine centered at pixel 
(95,70) with a DOB of 3 inch. 



Vehicle Motion (pixel*) 


Figure 10b: Filtered image using the 
method without prewhitening step. 

(the cross marks the pixel where 2 

has been maximized) 



Vehicle Motion (pixels) 


Figure 10c: Filtered image using the 
method with prewhitening step. 

(the cross marks the pixel where % 2 has 
been maximized) 
















These two different methods of optimal filtering are able to point out some buried objects 
that were not visible in the original collimated image. The choice of the method 
(prewhitening or not prewhitening) mainly depends on the nature of the noise. However, 
the method without the prewhitening step appears to be very sensitive to the nature of the 
noise. 


4- Conclusion 

In this section we first introduced some signal separation techniques which failed in 
producing images containing only buried objects because the assumption of the statistical 
independence of the source signals is not true. Next we studied an optimal filter which 
produced some interesting results because it is able to point out buried objects even when 
they are deep-buried. 

The last technique of optimal filtering required the user to select a region where a mine 
seemed to be buried. In the next section we introduce a new technique of image 
processing, neural networks, that could help us to move toward an automatic filtering 
process of the images. 
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Section 5 


Neural Network 


1-Introduction 

The human brain is a very complex system capable of thinking, remembering and problem 
solving using neurons. Some studies have shown that the brain stores information as 
patterns. Some of these patterns are very complicated and give us the ability to recognize 
objects from many different angles. This process of storing information as patterns, 
utilising those patterns, and then solving problems, encompasses a new field in computing 
that we use in this section to improve LMR images with the goal of deciding whether or 
not there is a buried mine. 
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2- From biological neurons to artificial neurons 

2-1- Biological neurons 

The individual neurons are complicated. They have a myriad of parts, sub-system, and 
control mech anisms , and there are over one hundred different classes. We will focus only 
on the simplest neuron. 

This neuron is a simple processing element that receives and combines signals from other 
neurons through input paths called dendrites. If the combined input signal is strong 
enough, the neuron ‘fires’, producing an output signal along the axon that connects to the 
dendrites of many others neurons. 



Figure 1: A simple neuron 
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2-2- Artificial neurons 


An artificial neuron tries to imitate the previous biological neuron. Figure 2 shows the 
schematic representation of an artificial neuron. 


I = 2 v j x j Summation 
Y = fO) Transfer 

*0 



Figure 2: A basic artificial neuron. 


The input signals are represented by x 0 ,x i ,x 2 ,...,x n ; these signals are continuous 
variables. Each of the inputs is modified by a weight, w 0 ,w l ,w 2 ,...,w n , whose function is 
analogous to that of the synaptic junction in a biological neuron. This artificial processing 
element consists of two parts: The first simply sums the weighted inputs resulting in a 
q uantit y /. The second part is a nonlinear filter, called the activation function, through 
which the signal flows. Figure 3 shows a typical activation function. 




Output value 



Input value 


Figure 3: A typical activation function. 


0(1) = —, where a is a coefficient that adjusts the abruptness of this function as it 
1H - e 

changes between the two asymptotic values. 


3- Artificial neural networks 

3-1 - Architecture of artificial neural networks 
An artificial neural network can be defined as: 

A data processing system consisting of a large number of simple, highly 
interconnected neurons in an architecture inspired by the structure of the cerebral cortex 
of the brain. 

These processing elements (neurons) are usually organized into a sequence of layers with 
full connections between the layers. This arrangement is shown in Figure 4, where the 
input layer is a buffer that presents data to the network. The top layer is the output layer 


39 




which presents the output response to a given input. The other layers are called hidden 
layers because they usually have no connection to the outside world. 


yi yq yr 



k^ 1 Layer 


Layer 


Layer 


Figure 4: Example of a neural network architecture. 


Two general kinds of neural networks are in use: the heteroassociative neural network in 
which the output vector is different than the input vector, and the autoassociative neural 
network in which the output is identical to the input. 

A typical neural network is ‘fully connected’, which means that there is a connection 
between each of the neurons in any given layer with each of the neurons in the next layer 
as shown in Figure 5. However, this is not the only kind of neural network; others have 
have been developed, like the feedback neural network where the output of one layer 
routes back to a previous layer. This one is shown in Figure 6. In our study we will use a 
heteroassociative, feedforward neural network. 
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Figure 5: Simple feedforward neural network 



Figure 6: Simple network with feedback and competition. 




1-7- Training an artificial neural network 

Artificial neural networks perform two major functions: learning and recall. Learning is the 
process of adapting the connection weights in an artificial neural network to produce the 
desired output vector in response to a stimulus vector presented to the input buffer. Recall 
is the process of accepting an input stimulus and producing an output response in 
accordance with the network weight structure. 

The learning rules of neural computation indicate how connection weights are adjusted in 
response to a learning example. In supervised learning, the artificial neural network is 
trained to give the desired response to a specific input stimulus. In unsupervised learning 
there is no specific response sought, but rather the response is based on the network’s 
ability to organize itself. Only the input stimuli are applied to the input buffers of the 
networks. The network then organizes itself internally so that each neuron responds 
strongly to a different set of input stimuli. These sets of input stimuli represent clusters in 
the input space. 

In our application of neural networks to LMR images we will use the supervised learning 
technique. 

3-2-1- Supervised learning 

The goal of supervised learning is to train the neural network to give a desired response to 
a specific input stimulus. We will call X the input learning vector, Z the output learning 
vector and Y the computed output of the neural network. Figure 7 shows the principle of 
the supervised learning technique. 
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Figure 7: A neural network with supervised learning. 


To start the learning process, we first randomly initialized all the coefficients w y of each 

layer and computed the first output of the network Y. The inputs to the comparator are the 
desired output vector Z and the actual output pattern Y. The error coming from the 
comparator is then utilized in the weights-adjusting algorithm to determine the amount of 
the adjustment to be made in the weights in each layers. This is an error-backpropagation 
process. This process occurs over and over until the error reaches a desired value. 








3-2-2 Backpropagation training for a multilayer neural network 

The error used in the backpropagation learning process is the square error defined by: 

Error = s 2 = [Z -Y] 2 


The method used to decrease this error, modifying the weights of the neural network, is 
the delta rule. This rule indicates that the change in a weight is proportional to the rate of 
the square error, e 1 with respect to that weight: 


= -n 


ds 2 


dw 


pq,r 


In our study we used some neural networks with 2 and 3 layers. To understand how this 
delta rule is applied we will study a 2 layer neural network (the 3 layer neural network is 
very similar). Figure 8 represents a 2 layer neural network. 



Figure 8: Sketch of multilayer network showing the symbols and indices used in deriving the 

backpropagation training algorithm. 

/. : result of the summation of the weighted inputs for the neuron i of the layer j. 
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O, j=f (/, j ), where/is the activation function. 

w ki j: weight of the output of neuron k, layer j-1, sent to neuron i, layer j. 



Then we can show that: 



where N is the number of the iteration involved, and a the coefficient of the activation 
function. An identical process is performed for each weight of the output layer to give the 
adjusted values of the weights. 
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3-2-2-2- Calculation of weights for the hidden layer neurons 


Since the hidden neurons have no target vectors the problem is a bit different. We must 
use the errors of all the output neurons: 


e 


2 



So using the delta rule: 


A *Vi =~ 1 h l 


de 2 _ y « d e q 


dw 


hp t l 


9=1 


And then using once more the chain rule of differentiation we can show: 


=T lh,pi J 2 <x( z q ~® * 2 )K,2(!-® 9 .2i )\ v p q ,2 a \&p,\ 0- °p.i )K 

^=1 

w hp,i (N+l) = *V,i (AO + , _ 


4- Application of neural networks to LMR images 

As a human, looking at both collimated and uncollimated images, we are able to identify 
surface-laid objects. So we would like to teach the neural network to recognize surface- 
laid objects and remove them from collimated images. Thus, during the learning step we 
will present to the network some original input images containing buried mines and 
surface-laid objects, and the corresponding output collimated images from which the 
surface-laid objects have been removed. 
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4-1- Build the input and the output 
4-1-1- Nature of the input and the output 

We want the neural network to learn how to remove surface-laid objects using collimated 
and uncollimated image properties (shift in the position of the buried objects in the 
collimated images and information about the surface-laid objects in the uncollimated 
images). Information in both uncollimated images are very similar. Because the larger the 
input vector is, the more complicated the neural network is, we will only use one of the 
uncollimated images in the input vector. So the input vector will contain information from 
both collimated images and from one of the uncollimated images. 

The corresponding output vector is an image of the exact same mine as for the input 
image, at the same location and the same DOB, but without any surface-laid object, or 
without any slope. 

During the learning step we will present to the system some images containing some 
surface-laid objects and some buried mines at certain positions. However, we want the 
network to be able to give good results wherever the objects are. So we will not present 
to the system all of the images, but some region of the images, so that the input contains 
information about the local variation of the energy but no information about the position 
of the object. We used some 3*3 or 5*5 pixel square regions. So the input vector contains 
the values of the pixels of 3*3 pixel square regions, centered at the same position on both 
collimated images and on the uncollimated image. 
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To use the information from the neighbor pixels, we associated to the input vector a single 
output pixel which represents the value of the pixel of the output image at the same 
location as the center of the squares. Figure 9 represents the input and the output vectors 
of the neural network. 


Collimated i 


Uncollimated i 


Collimated j 




Input vector 


Neural 

Network 


Output i 


Figure 9: Representation of the input and the output of the neural network 
(i and j mean the front and the rear). 


4-1-2- Rescale the input and the output vectors 

The energy deposition in the detectors depends on different factors (nature of the soil, 
kind of mine,...etc. ), so to design a network able to achieve good results in every 
situation, we have to rescale the input and the output images so that each image contains 
values included in the same range so that the neural network could be used in as many 
cases as possible. 
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We used the following normalization method: 


Inom&y) 


_ /^soil 

Max xy (l x (x,y)) 


where/,(jc,y) 


(I(x,y)-E^) 


■'soil 


where /(x,y)is the original image and Esoil ,the energy deposition from the soil, is 

supposed to be the energy deposition most represented in the image which we extract by 
looking at the histogram of the image. 

This normalization method computes the relative enegy value of each pixel compared to 
the energy of the soil, and then divides by the maximum relative value for all of the pixels. 


4-2- Set the parameters of the network 

When the architecture of the neural network has been chosen we have to choose the 
number of layers, the number of neurons in each layer, and the activation function. 

4-2-1- number of layers and neurons 

In this study we arbitrarily decided to use a 3 layer neural network. So now we have to 
choose the number of neurons in each layer. 

As the number of neurons increases, the performance of the system increases; but the 
number of neurons is limited by the number of learning examples. Indeed, it has been 
proven that to design a system that is able to generalize what it has learned from examples, 
the number of neurons must be about 10 times lower that the number of learning vectors. 
The system can been represented the following way: 
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Input layer Hidden layer Output layer 


If the size of the input vector is: numjrow x numcoL, then the condition to be satisfied for 
the number of neurons is: 

num col > 10 .(X.Y.Z) 


4-2-2- The activation function 

To choose the activation function we have to take into account the characteristics of the 
normalized images which contain pixels into the interval [-1; 1 ] where 0 corresponds to the 
energy deposition due to the soil. So to keep values included into the interval [-1;1] and 
centered around 0 we use the activation function: 

2 

d>(x) = —arctan(er.x) 
n 

where a is the coefficient of the activation function which can be set to different values. 
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K=10 



Figure 11: Activation function for different values of a. 

So increasing a allows the neural network to be very selective, while decreasing a causes 
the activation function to become less sensitive to the variation of jc. 

4-3- Choice of the learning examples 

The choice of the learning input and output vectors is very important because the 
performances of the system will mostly depend on it. We used three sets of images: 

Image set 1: surrogate plastic mine with a DOB of 1”. Surface laid objects: triangular 
wood piece, soda can, bolt, nut. 

Image set 2: surrogate steel mine with a DOB of 1”. Surface laid objects: 2 pieces of 
wood and a rock. 

Tmage set 3: surrogate plastic mine with a DOB of 1”. Surface laid objects: 2 pieces of 
wood and 2 rocks. 
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These 3 image sets provide 2147 learning input vectors. Figures 9a, b, c, d represent 
Image set 1. 



raster direction raster direction 

Figure 9c: Input rear uncollimated image Figure 9d: Output rear collimated 

image 

Figure 9a ? b, c, d: Example of a typical learning set of images 

5- Experimental results 

To test this method we have trained the network under different conditions, using different 
sizes of the input vectors [(3*3) pixels or (5*5) pixels from each of the three input 
images], different number of neurons, different values for the a coefficient of the 
activation function, and different learning images from the three previous sets. 

Because a backward shifting appears in the front collimated image and a forward shifting 
appears in the rear collimated image, we trained two different networks to teach them to 







UOpOUl «[Om»A 


recognize the backward shifting for one and the forward shifting for the other. These 
networks are then used to respectively filter the front and the rear collimated images. The 
following results were obtained with the network trained to filter the rear collimated 
image. 

5-1- Size of the selection square 

Using a 5*5 square pixel to take into account the neighborhood of a pixel appeared to 
give better results, which tends to prove that using information from neighbor pixels is an 
interesting idea. However, the drawback of such a method is that the network output 
associated with an n*n input image is a (n-2)*(n-2) image. 

5-2- Influence of the number of neurons 

When using a large number of neurons (more than the number of learning vectors), the 
system computes very good output images when applied to one of the learned images, but 
foils to provide good results for non-leamed images, as shown in Figures 10 and 11. In 
this example we used a neural network containing 75 neurons in the first layer, 50 in the 
second layer, and 1 in the output layer ( we call it 75*50*1 network). The total number of 
neurons is 9425 which is larger than the number of learning vectors (2147). 



Figure 10a: Input rear collimated image Figure 10b: Input rear uncollimated image 
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To get a network to be able to compute good results in every situations we need to verify 
the condition num col > lO.(XJT.Z). Thus, we used a 5*3*1 network (five neurons in 
the input layer, 3 in the hidden layer and one in the output layer) and a 3*2*1 network. 
These networks do not provide as good results as the previous one when the input is a 
learned-image, however, they are better when applied to non-leamed vectors. 

We need the total number of neurons to be less than the number of learning vectors, but 
we also need enough neurons to model the system. This is the reason why the 5*3*1 
network gives better results than the 3*2* 1 network. 

5-3- Influence of the a coefficient 

This coefficient sets the way the output of a neuron reacts to an input signal. The bigger 
this coefficient is, the more difference a neuron makes between two values close to 0 and 
the less difference it makes between two larger values. The lower this coefficient is, the 
less difference a neuron makes between two values close to 0. Experimentally it appears 
that 0.5 is a good value for this coefficient. 

5-4- Final results 

Finally the neural network used was a three layer, 5*3*1 network, with an a coefficient of 
the activation function equal to 0.5, a 3*3 pixel selection square, and using image sets 1,2 
and 3, or the image sets 1 and 3 as learning images. 

Figures 12,13, 14, 15 and 16 show the outputs of the network when different images are 
applied. 
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Figure 12a: Input rear collimated image 


Figure 12b: Input rear uncollimated image 
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Figure 12c: Output rear collimated image 


Figure 12d: Theoretical output rear 
collimated image used during the 
training step 


Figures 12: Inputs and output of the neural network, when using a set of 
images presented to the system during the learning step. 

The learning images are made of the image sets 1,2 and 3. 
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Figure 14a: Input rear collimated image Figure 14b: Input rear uncollimated image 
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Figure 14c: Output rear collimated image 

Figures 14: Inputs and output images of the neural network, 
when applied to a non-leamed set of images. 

The learning set is made of the image sets 1,2 and 3. 
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collimated image 


Figure 15b: Input rear uncollimated image 
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Figure 15c: Output rear uncollimated image 

Figures 15: Inputs and output images of the neural network, 
when applied to a non-leamed set of images. 

The learning set is made of the image sets 1 and 3. 








Figure 16a: Input rear collimated image 


Figure 16b: Input rear uncollimated image 
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Figure 16c: Output rear collimated image 

Figures 16: Inputs and output images of the neural network, 
when applied to a non-leamed set of images. 

The learning set is made of the image sets 1 and 3. 










So the network is able to remove the surface-laid objects when applied to non-leamed 
images. However, the results seem to depend highly on the learning step. Indeed, we 
trained two different networks with the exact same internal characteristic but with two 
different kinds of learning images, one containing only the images of some plastic mines, 
another containing the images of plastic and metal mines. The network trained with the 
first set gives better results when applied to a plastic mine. This can be explained by the 
feet that the first network focuses on energy peaks, while the second network computes 
its internal weights to model both a peak and a depression of energies. So the first one is 
better when applied to plastic mines. 

6- Conclusion 

In this section we introduced the neural networks, their biological basis and their ability to 
learn. We designed a simple feedforward network in an attempt to remove surface-laid 
objects, using information from collimated and uncollimated images. 

The results of this very first attempt, even if they are not perfect, are interesting because 
this system succeeded in removing surface-laid objects from unknown collimated images; 
we employed a very simple feedforward neural network and we used only three sets of 
images during the learning step. 

For these reasons we continue to investigate using neural networks as a surfece-laid object 
removal technique, and improve the system. 
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Three important elements to work on to improve the quality of the results are: 

(1) the architecture of the network ( a neural network with feedback 
would allow the system to compute the output using the neighbor 
pixels it has already calculated) 

(2) the number of learning sets of images (the more information we give 
to the network during the learning step, the better the system is ). 

(3) The learning images. Computing different networks for specific 
situations ( plastic mine, metal mine,... ) could highly improve the 
quality of the results. 


62 





Section 6 


Automatic Image Processing 


The final goal of the signal and image processing techniques applied to the LMR, would 
be an automatic processing of the images. The introduction of the neural networks has 
been a first step in that direction. In this section we study this aspect more carefiilly. 


1- Introduction 

The neural network technique does not need human intervention during the process; the 
images are automatically processed. However, some other methods that have been 
previously developed need the user to select an object. So to achieve an automatic 
treatment in these cases, we need to design a technique that is able to recognize these 
objects; this is called object recognition. 

2- Object recognition 

2-1 - Contour detection 

Contour detection is the first task in the object recognition process. Numerous contour 
detection methods have been developed so far. Most of these methods are based on the 
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computation of the gradient of the image and on the use of a threshold. They are very 
efficient when applied to images with very sharp edges. However, in the case of LMR 
images this condition does not hold, because energy transition from the soil to a buried 
object is soft. Thus, these methods are not efficient when applied to LMR imag es, as 
shown in Figure lb. 



50 100 150 200 2SO 

Vehicle Motion (pixels) 



Vehicle Motion fohcelel 


Figure la: Collimated image 


Figure lb: Result of the Sobel 
contour detection method 


Another method of contour detection would be the use of the energy level. Indeed, the 
contour of a mine is defined by a constant energy level. However, in this case, as shown 
in Figure 2, we have to choose the energy contour levels corresponding to the edge of a 
mine. 



(applied to Figure la image) 
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So these two contour detection methods are not veiy efficient when applied to LMR 
images. 

A solution for this problem may be the use of the neural network. It might be possible to 
teach the network to recognize contours by providing it with the gradient function at each 
pixel location, and the value of the neighbor pixels. 


2-2- Labeling task 

Once the contours have been detected, the next step is to label each object and to then 
put into relation the objects in each image. This labeling task can be easily done by using 
connected neighborhood relations. At the end of this step we have an image where each 
pixel contains the number of the object it is part of ( see Figure 3). 

xio 4 
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Vehicle Motion (pixels) 


Figure 3: Resulting image 
of the labeling task. 
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3- Conclusion 


The major difficulty in the process of object recognition is the contour detection task. It 
may be possible to use a neural network to do this. 

An automatic object recognition method would allow us to develop new image 
processing techniques based on shape comparison of objects, symmetry between objects, 
object shifting, geometry, and so on. All these methods might give precious information 
that would help the user to decide whether or not there is a buried mine. 
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Section 7 


User Interface 


1-Description of user interface 

Several signal and image processing techniques have been developed in this study that 
the user may want to use on site to improve the images. So we designed a user interface 
that allows the user to easily apply these filters to LMR images. To run this interface the 
user needs to go to the directory :\programs\image_filter, and run the program main. 

This interface, programmed in the Matlab language, is made of a control window which 
contains three major control commands, as shown in Figure 1: 

Images command: open, save, print and clear the desired image. 

Filter command: perform the selected filtering on the selected image 
Linear combination command: perform linear combination manipulatio n 
on the selected images. 

Using this interface the user can easily apply successive filters to one image. 
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Figure 1: Command window of the user interface 


2- Command description 

In this subsection we describe each command. But each filter is based on the same 
scheme: select the filter, select the image to filter and follow the instructions displayed 
in the dialog box. 

2*1- Image command 

open ...: opens a desired image of format matfile or textfile. 
save as... : asks the user to select an image and then save it. 
print : asks the user to select an image and then print it. 
clear images : clear all the images. 

2-2- Filter 

wiener : asks the user to select an image and then apply the Wiener filter. This filter may 
be used as a first step to remove noise from the image before applying any other filter. 





histogram equalization : asks the user to select an image and then equalize its histogram. 
This filter may be used to point out some objects which do not appear in the original 
image because their energy deposition is very low compared to the energy deposition of 
the soil. 

optimalfilter : asks the user to choose an image and to select a region with the mouse and 
then apply the optimal filter to that image. This filter maximizes the signal-to-noise ratio 
in the selected region, pointing out the buried object that may be in that zone. 

neural network : asks first which collimated image the user wants to filter (front or rear), 
then ask the user to select 3 images (2 collimated and 1 uncollimated), and then apply the 
neural network. This filter may be used to remove surface laid objects, but also to point 
out some buried objects which weakly appear in the original collimated image. 

remove object : asks the user to select a pair of collimated and uncollimated images, to 
choose the number of objects to remove from the selected collimated image, and then to 
select with the mouse the object. Finally, the program performs a subtraction-interpola¬ 
tion method to remove the objects. This method may be used to remove some surface- 
laid objects that may hide some buried objects. 

2-3- Linear combination 

subtraction : asks the user to select the subtraction factor and then the two images to 
subtract: normalization factor ( noted ‘ norm ’ ) performs: 
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energy image, . 

output = image, - jmage 2 

energy image 2 

Selected value (noted ‘ value ’) ask the user to enter the subtraction factor a and then 
performs: 

output = image l -aJmage 2 

This method can be used to remove surface-laid objects (select a collimated image, an 
uncollimated image and the normalization factor), or to point out a buried object which 
then appears as two different objects of opposite intensity and shifted in the vehicle 
motion direction (select the two collimated images and the normalization factor). 

addition : ask the user to enter the value of the addition factor a, the two images to add, 
and then performs: 

output = image l + aJmage 2 . 

This method may be used to remove the energy deposition from the soil in some specific 
situations. 

3- Architecture of the program 

In this study of LMR si g nal and image processing techniques we used Matlab to test each 
method. We used this same software to design the user interface. 

Each program contains at its very beginning a brief description of what it has been 
designed for. Figure 2 presents the architecture of the program. 
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Conclusion 


In this report we studied different kinds of image filtering techniques applied to LMR 
images. We first introduced some image enhancement techniques that improve the 
visibility of the image and sometimes point out some details. Next, we looked at some 
linear combinations of the images which gave us information regarding the presence of a 
buried mine. Then, we introduced the optimal filter which is an efficient way to pick out 
mine from the soil, and at the end we studied the use of the neural network as a surface- 
laid object removal technique. The neural network method appears to be a very efficient 
method because even a very simple network, trained with very few images, gave good 
results. We will continue studying these networks, working on new architectures and 
acquiring new learning images, because the more images we use during the learning step 
the better the network is. 

These image processing techniques sometimes give very useful information regarding the 
presence of a buried mine. This is why we will continue to investigate other techniques, 
especially object recognition techniques, that would lead to an automatic treatment of the 
images. 

We should also look to develop neural networks that could be used to detect an object’s 
contour, to compute the DOB of a mine, and/or to perform distortion removal (image 
enhancement) of distorted images. 
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